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(54) Electronic sound source having reduced spurious emissions 



(57) An electronic sound source comprises an 
adder which calculates a sum of volume data and differ- 
ential volume data in response to each clock signal sup- 
plied at equal intervals of time and transfers it to a limrter 
and a volume register. The sum volume data is then lim- 



ited to a predetermined value by the limiter and passed 
across a volume register to a volume controller where it 
is multiplied by an output of a mute processor. 
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Description 

BACKGROUND OF THE INVENTION 

Field of the Invention 5 

The present invention relates generally to the field 
of electronic sound source generators and, more partic- 
ularly, the present invention relates to an electronic 
sound source having reduced spurious emissions and io 
noise for use In video games or other electronic 
devices. 

Description of the Prior Art 

15 

In conventional electronic devices, special effects 
sounds and BackGround Music (BGM) are played back 
in response to interaction wrth game software by an 
operator. In conventional video game machines, the 
sound source device is typically in the form of an FM so 
sound source for generating sounds of a scale by vary- 
ing the frequency of a waveform comprising a funda- 
mental wave and its harmonics. Alternately, a PCM 
sound source device is used for producing a desired 
scale of sound by changing the period of reading a cor- 25 
responding waveform to the desired scale from a funda- 
mental waveform stored in memory. In order to produce 
background music (BGM) sound, a time sequence of 
score data which has been prepared and aligned 
includes various sound data such as scales, emission 30 
and termination of sound, sound effects and music as 
well as time data. These are interpreted in real time 
while controlling in succession the sound scale, emis- 
sion and termination registers in the sound source. 

The preparation of BGM sound data in the form of 35 
score data allows ease in the changing of tones and 
scale of sound during reproduction as compared with 
controlling the scale emission and termination of 
sounds through implementing programs in the sound 
source. Accordingly, this method is well-suited for video 40 
game machines and the like where real-time actions are 
needed in quick response in order to react to operator 
like where real-time actions are needed in quick 
response in order to react to operator interaction with to 
machine. A conventional system for producing sounds 45 
is shown in Figure 24 wherein a central processing unit 
(CPU) 201 controls a sound source device provided 
with score data use in a video game machine such that 
a sequence of the score data is retrieved at equal inter- 
vals of time through time division multiplexing of the so 
CPU. The CPU 201 is utilized for controlling timing dura- 
tion scale and level of sound at the sound source device 
202 to emit BGM sound. The method of interpreting the 
score data through time division multiplexing of the CPU 
is less costly as no particular peripheral devices are ss 
required provided that the CPU 201 has substantial 
processing capability. 

When the sound source device 202 in a video game 
machine uses a PCM sound source, the level of the 



reproduced sound is specified as volume data by the 
CPU 201 . More particularly, the sound source 202 com- 
prises a waveform memory 221 for storing waveform 
data, a pitch register 222 for holding pitch data deter- 
mined by the CPU 201, a pitch shifter for changing the 
pitch of the waveform stored in the waveform memory 
according to the pitch data held in the pitch register 222 
and a volume register 224 for holding volume data 
determined by the CPU 201 . Additionally, a volume con- 
troller 225 changes the level of an output from the pitch 
shifter 223 according to the volume data held in the vol- 
ume register. 

As shown in Figure 25, upon receiving a request for 
emission of a particular sound, the CPU 201 supplies 
corresponding pitch data to the pitch register 222 and 
corresponding volume data to the volume register 224. 
As shown in Figure 26(c) when the pitch and volume 
data are given at a time t30 the pitch shifter 223 
changes the pitch of a waveform from the waveform 
memory 221 according to the pitch data from the pitch 
register 222 as shown in Figure 26(a). This transfers a 
pitch changed waveform to the volume controller 225. 
The volume controller 225 then changes the level of 
waveform output from the pitch shifter 223 according to 
the volume data from the volume register 224 as shown 
in Figure 26(b). Consequently, a sound corresponding 
to the pitch and volume data determined by the CPU 
201 is then played back. 

In these conventional devices, however, the chang- 
ing level of the waveform output of the pitch shifter 223 
in the volume register 224 is executed through multipli- 
cation of the output of the pitch shifter 223 by the vol- 
ume data from the volume register 224. The resultant 
output of the volume controller is thus discontinuous at 
a time t30 when the volume level is changed. Because 
the output of the volume controller 225 is not continu- 
ous, it often results in the introduction of unwanted 
sounds such as pop and additional noise in the repro- 
duced sound. These additional noises are undesirable. 

In order to prevent the introduction of such noise, It 
has previously been proposed to change the volume 
data gradually. In such devices, the CPU has been 
responsible for changing the volume data in sequence 
and this significantly increases the load on the CPU. 
Furthermore, in a sound source having a pair of volume 
registers 224 and volume controllers 225 for each of the 
two left and right channels, a panning action may be 
requested in order to simulate a shift of sound from left 
to right or visa versa. In general, the panning action is 
implemented by gradually changing the volume level 
between the left and right channels. There have been 
increased demands in conventional video games to 
execute the shift of sound from left to right or visa versa 
promptly or at a higher rate of speed. This demand can- 
not be anticipated and therefore no preparation for such 
change can be made. Therefore, it is often difficult for 
the CPU to adequately make such a change. 

In light of the foregoing, it is an object of the present 
invention to provide a sound source device in which the 
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load on the CPU of the electronic device associated 
with the sound source is not increased and one in which 
the noise in a reproduced sound is actually decreased. 

SUMMARY OF THE INVENTION 5 

The sound source device according to the present 
invention comprises a waveform buffer for storing wave- 
form data, a pitch memory for holding pitch data, a pitch 
shifter for reading waveform data from the waveform 10 
buffer and changing the pitch according to the pitch data 
held in the pitch memory. An amplitude memory holds 
volume data and a level controller receives an output of 
the pitch shifter in order to adjust its level according to 
the volume data held in the amplitude memory. A differ- 75 
ential amplifier memory holds differential volume data 
and a volume changer changes the volume data in the 
amplitude memory according to the differential volume 
data held in the differential amplitude memory. 

In the sound source device of the present invention, 20 
while the pitch data, volume data and differential volume 
data are predetermined, the pitch shifter reads out a 
desired waveform from the waveform buffer and 
changes its pitch according to the pitch data from the 
pitch memory before transferring it to the level control- 25 
ler. The level controller then adjusts the level of an out- 
put of the pitch shifter according to the volume data from 
the amplitude memory. Meanwhile the volume changer 
modif ies the volume data stored in the amplitude mem- 
ory according to the differential volume data stored in 30 
the differential amplitude memory. Consequently as the 
volume data stored in the amplitude memory is gradu- 
ally modified according to the differential volume data 
from the differential amplitude memory during activation 
of the differential volume data, the output level of the 35 
pitch shifter can be varied gently by the level controller. 
Furthermore, if the differential volume data is not called 
for, the output level of the pitch shifter is adjusted 
according to the volume data directly from the amplitude 
memory with no use of the volume data changing action 40 
of the volume changer. The resultant output is free of 
unwanted noise, providing a clearer, cleaner signal. 
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Figure 1 is a schematic block diagram which illus- 
trates a circuit arrangement of a video game 
machine that embodies a sound source controller 
of the present invention; 

Figure 2 is a schematic block diagram which illus- so 

trates a Sound Processing Unit (SPU) for use with 

a video game machine that embodies the sound 

source controller of the present invention; 

Figure 3 is a diagram showing a format of a data 

bank used in the sound source controller and a ss 

sound source of the present invention; 

Figure 4 is a diagram showing a format of attribute 

data assigned in the data bank illustrated in Figure 

3; 



Figure 5 is a diagram explaining the settings of an 
envelope allocated to the attribute data; 
Figure 6 is a schematic block diagram which illus- 
trates an envelope generator for use in the sound 
source controller of the present invention; 
Figure 7 is a diagram which illustrates storage of 
the attributed data; 

Figure 8 is a schematic block diagram which illus- 
trates a volume control for use in the sound source 
controller of the present invention; 
Figures 9 A-B are diagrams illustrating operation of 
the volume control; 

Figure 10 is a diagram explaining an output pro- 
duced by the volume control; 
Figure 1 1 is a diagram which illustrates a format of 
score data for controlling the sound source in the 
video game machine of the present invention; 
Figure 12 is a diagram which illustrates another for- 
mat of score data for controlling the sound source in 
the video game machine of the present invention; 
Figure 13 is a diagram which illustrates a format of 
music data in the score data; 
Figure 14 is a diagram explaining assignment of the 
score data; 

Figure 15 is a schematic block diagram of the 
sound source controller for controlling the sound 
source with the score data; 
Figure 16 is a diagram which illustrates assignment 
of the score data stored in a score data storage of 
the sound source device; 

Figures 17 A-C are diagrams which illustrate the 
contents of a reference table for use during reading 
of the score data; 

Figure 16 is a diagram explaining reproduction of 
the score data in the sound source controller; 
Figure 19 is a diagram explaining operation of the 
score data in the sound source controller; 
Figure 20 is a f tow chart explaining reproduction of 
the score data in the sound source controller; 
Figure 21 is a schematic block diagram showing a 
detailed arrangement of the sound source control- 
ler of the present invention; 
Figures 22 A-B are diagrams explaining timer inter- 
rupt operation of a sound controller in the sound 
source controller; 

Figures 23 A-B are diagrams showing the ratio of 
the load for the sound controller; 
Figure 24 is a block diagram showing an arrange- 
ment of a conventional video game machine; 
Figure 25 is a block diagram showing an arrange- 
ment of a known sound source device in a conven- 
tional video game machine; 
Figures 26 A-C are diagrams which explain opera- 
tion of the known sound source device. 
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DETAILED DESCRIPTION OF A PREFERRED 
EMBODIMENT 

In the preferred embodiment of the present inven- 
tion, the sound source device is incorporated into a s 
video game machine for generating both background 
and special effects sounds for a video game. The video 
game responds to commands from an operator for 
reading and executing a computer game program. A 
block diagram of a preferred embodiment of the present w 
invention is set forth in Figure 1 . 

In Figure 1 , a video game embodying the present 
invention comprises a control system 50 having a cen- 
tral processing unit (CPU) 51 and its related peripheral 
devices. A graphics display section 60 has a graphics 75 
processing unit (GPU) 62 which is connected to a frame 
buffer 63. A sound generation system 70 has a sound 
processing unit (SPU) 71 tor generating background 
music and special effects sounds. An optical disc con- 
troller/reader module 80 controls reading of data stored 20 
on a digital optical compact disc which is typically the 
computer software for the game along with image and 
sound data. A communications controller module 90 
controls input and output of commands from a controller 
92 manipulated by the operator. The communications 25 
controller module 90 also controls the transfer of infor- 
mation from an auxiliary memory 93 which stores infor- 
mation that, for example, comprises the settings for the 
game as well as sound and image information. A data 
bus 100 extends from the control system 50 to the com- 30 
munications control module 90 and interconnects the 
various modules. 

In addition to the CPU 51, the control system 50 
also includes a peripheral device controller 52 which 
controls interrupts of the microprocessor as well as 35 
Direct Memory Access (DMA) transfers. A main mem- 
ory 53 is comprised of RAM and a ROM 54 carries soft- 
ware programs including the operating system for 
controlling operation of the graphics system 60 and the 
sound system 70. The CPU 51 operates the operating 40 
system stored in the ROM for controlling the entire 
machine. 

The graphics system 60 is comprised of a Geome- 
try Transfer Engine (GTE) 61 for performing coordinate 
transformation or the like. The GPU 62 draws images in 45 
response to commands from the CPU 51. A frame 
buffer 63 stores images drawn by the GPU 62 and a 
video decoder 64 decodes coded image data which is 
compressed by orthogonal transformations such as a 
discrete cosine transformation. The GTE 61 has a par- so 
allel computing mechanism for performing a plurality of 
arithmetic operations simultaneously. The GTE 61 per- 
forms high speed coordinate transfer operations, light 
source calculations or matrix or vector calculations 
upon receiving a calculation command from the CPU 55 
81. More particularly, the GTE 61 calculates the coordi- 
nates of polygons up to 1 .5 million times per second for 
flat shading of the polygons for a triangle shape in a sin- 
gle color. This contributes to a decrease in the load on 



the CPU 51 and allows the video game to perform high- 
speed operations. 

The GPU 62 is responsive to a drawing command 
from the CPU 51 for drawing a polygon or graphic on the 
frame buffer 63. The GPU 62 processes up to 
360,000 polygons for a single drawing. The frame 
buffer 63 comprises a so-called dual port RAM for 
simultaneously receiving data from the GPU 62 or the 
main memory and outputting data to the display. The 
frame buffer 63 has a 1 megabyte capacity which repre- 
sents a 16-bit pixel matrix having a resolution of 1024 
along the horizontal and 512 in the vertical. Any desired 
area in the matrix of the frame buffer 63 can be released 
as a video output. 

Additionally, the frame buffer 63 includes an area 
for storage of a Color LookUp Table (CLUT) which is 
used as a reference in processing image data. For 
example, this may include polygons of the GPU for 
drawing and a texture area for storage of texture data 
mapped to the polygons produced by the GPU 62. The 
CLUT and texture area can be varied dynamically 
depending on changes in the display area. 

In addition to flat shading, the GPU 62 performs 
Gourad shading in which the color of a polygon is deter- 
mined by interpolation of vertex colors, and texture 
mapping for applying texture data stored in the texture 
area of a polygon. In Gourad shading or texture map- 
ping, the GTE 61 calculates the coordinates of up to 0.5 
million polygons in one second. The decoder is respon- 
sive to a command from the CPU 51 for decoding still or 
motion image data retrieved from the main memory 53 
and storing them again in the main memory 53. The 
decoded data may be used as the background of a 
graphic produced by the GPU 62 as having been trans- 
mitted via the GPU 62 to the frame buffer for storage. 

The sound system 70 comprises the Sound 
Processing Unit (SPU) 71 which is responsive to com- 
mands from the CPU 51 for generating background 
music or special effects sound. In the sound system 70, 
a sound buffer 72 stores waveform data from the SPU 
71, and a loud speaker 73 emits the background music 
or special effects sound generated by the SPU 71 . The 
SPU 71 is capable of performing adaptive differential 
pulse code modulation (ADPCM) decoding for repro- 
ducing audio data in ADPCM format by transforming 
from a 16-bit word to a 4-bit differential form. The SPU 
also performs a playback function for retrieving wave- 
form data from the sound buffer 72 to generate a corre- 
sponding sound as well as a modulation function for 
modulating the waveform stored in the sound buffer 72. 
Accordingly, the sound system 70 acts as a sampling 
sound source and upon receiving a command from the 
CPU 51 produces background music or special effect 
sounds corresponding to the waveform data supplied 
from the sound buffer 72. 

The optical disk controller module 80 comprises an 
optical disk 81 for reproducing a computer program or 
other data stored in an optical disk. The disc controller 
module 80 includes a decoder 82 for decoding the com- 
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puter program or other data contained on the disc. For 
example, this decoder includes a mechanism for decod- 
ing the error correction code (ECC) form of the data. 
The disc controller module 80 also includes a buffer 83 
for accelerating the reading of data from the optical disk 5 
by temporarily storing reproduced data from the optical 
disk device 81. 

It is understood that the audio data stored In an 

_ optical disk and produced by the optical disk device 81 
is not limited to the ADPCM format but may also be in 10 
PCM form as produced by analog-to-digital conversion 

. of audio signals. If ADPCM audio data which is encoded 
as a 4-bit differential from a 16-bit digital (PCM) data is 
read, it is decoded by the decoder 82 and expanded 
back to a 16-bit digital word for storage in the SPU 71. is 
Alternatively, when PCM data is read, e.g. 16-bit digital 
format, it is decoded by the decoder 82 and fed into the 
SPU 71 or it is directly transferred to drive the loud 
speaker 73. 

The communications controller module 90 com- 20 
prises a communications controller 91 for controlling 
transfer of data across the bus 1 00 to and from the CPU 
51 . A controller 92 enters commands from the operator, 
and a memory card 93 stores game setting data. The 
controller 92 has 16 instruction keys for entry of the 25 
operator's instructions and upon receiving a command 
from the communications controller 91, it transmits 
instruction data assigned to the keys to the communica- 
tions controller 91 at a rate of 60 times per second in 
synchronous mode. The communications controller 91 30 
further transfers the instruction data from the controller 
92 to the CPU 51. As a result, the CPU 51 receives the 
operator's instruction and performs its corresponding 
actions according to the game program instructions. 

In order to store the game settings in memory, they 35 
are delivered from the CPU 51 to the communications 
controller 91 which in turn stores them on the memory 
card 93. The memory card 93 is connected by the com- 
munications controller 91 to the bus 100. Because the 
memory card 93 is separated from the bus 100, it can 40 
be removed from the machine while the machine is 
being energized. This allows exchange of multiple 
memory cards 93 for carrying different games or game 
settings. 

The bus 1 00 is also connected to a parallel I/O (out- 45 
put/input) port 101 and a serial I/O port 102 of the video- 
game machine. The video-game machine can thus be 
connected via the parallel I/O port 101 to any peripheral 
device and at the serial I/O port 102 to another video- 
game machine. It is necessary for the video-game so 
machine to transfer huge amounts of image data at high 
speed between the main memory 53, the GPU 62, the 
video decoder 64, and the decoder 82 for reading a pro- 
gram and displaying or drawing a desired image. For 
this purpose, the video-game machine performs direct ss 
data transfer or DMA transfer between the main mem- 
ory 53, the GPU 62, the video decoder 64, and the 
decoder 82 without passing the CPU 51 by means of 
the controlling action of the peripheral device controller 



52. This arrangement decreases the load on the CPU 
51 and also permits the data to be transferred at a 
higher speed. 

Upon powering up the video-game machine, its 
CPU 51 actuates the operating system stored in ROM 
54. While the operating system is being actuated, the 
CPU 51 controls the operations of the graphic system 
60 and the sound system 70. More specifically, the CPU 
51 upon starting the operating system, initializes the 
entire machine by checking every device and drives the 
optical disk controller module 80 for performing read-out 
of a game program from the optical disk. When the 
game program starts, the CPU 51 controls the graphic 
system 60 and sound system 70 in response to com- 
mands from the operator for displaying images and 
emitting the corresponding music or special effects 
sounds. 

In order to produce the corresponding music or 
special effects sounds for an image, the video-game 
machine has a sound source for generating music and 
special effects sounds and a sound source controller 
which is responsive to commands from the operators for 
controlling the action of the sound source. In practice, 
the sound source controller is implemented by a combi- 
nation of operations performed by the CPU 51 and SPU 
71. However, it is substantially controlled by the CPU 
51. 

As shown in Fig. 2, the SPU 71 comprises a pitch 
shifter 1 1 1 for reading a waveform from the sound buffer 
72 and changing its pitch in response to a command 
from the CPU 51. A clock generator 112 produces a 
clock signal for synchronizing operations. A noise gen- 
erator 1 13 is responsive to an output of the dock gener- 
ator 112 for producing a noise. A selector switch 114 
switches between outputs of the pitch shifter 1 1 1 and 
the noise generator 113. An envelope generator 115 
produces an envelope of sound data by varying the 
amplitude of a waveform output of the switch 114 
through level controlling. A mute processor 116 
switches the sound on and off, and two, left and right, 
volume devices 1 17L and 1 17R adjust the intensity or 
balance between the left and right channels. 

The sound buffer 72 holds a number of waveforms 
of a period length representing sounds. The waveforms 
are stored in the form of 4-bit ADPCM data described 
previously and after read out, are converted into 16-bit 
PCM format by the SPU 71 before being transmitted to 
the pitch shifter 111. This allows the waveform storage 
area of the sound buffer 72 to be undersized as com- 
pared with direct storage of the PCM data and a greater 
number of waveforms can be stored. The main memory 
53 holds the envelope of sound data, such as rise and 
decay of the waveform, corresponding to a period 
length of the waveform stored in the sound buffer 72. 
Although Fig. 2 shows a circuitry arrangement for han- 
dling a piece of sound (one voice), the connection from 
the pitch shifter 111 to the volume devices 117L and 
1 1 7R is made in multiplicity for 24 voices. The outputs of 
the multiple volume devices 1 17L and 117R are joined 
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together to an output of two, left and right, channels. In The envelope generator 1 1 5 modifies the amplitude 
the sound source device of the present Invention, 24 dif- of the waveform data from the pitch shifter 1 1 1 accord- 
ferent voices are produced and emitted at the same ing to the envelope supplied by the CPU 51. As the 
time. It is also possible that the waveform in the sound result, audio data for one voice is generated. In a similar 
buffer 72, envelope, intensity, and balance between the 5 manner, the remaining 23 voices of audio data are pro- 
left and right channels of each voice are modified inde- duced. The voice data are then controlled in intensity 
pendently. Accordingly, the sound source device can uti- and balance between the left and right channels with 
lize multiple voices to produce a harmony or simulate the volume devices 1 17L and 1 17R and if desired, sub- 
playing with a plurality of instruments. jected to reverberation processing before being mixed 
The sound source device is also capable of rever- 10 together. Finally, the sound data requested by the CPU 
beration processing in which a series of time lagged 51 is released. 

audio outputs are combined together. More specifically. Information including waveform data and envelope 
the SPU 71 further comprises two switches 118L and data for generating the audio data of each voice is 
1 18R for determining whether or not a group of 24 voice stored on an optical disk or recording medium in the 
outputs is to be reverberation processed. A reverbera- 75 form of a bank of files which contain setting elements 
tion processor 119 for time lagging the voice outputs of (programs) of the waveform and envelope data. As 
the switch 1 18L from one another, a volume device 120 shown in Fig. 3, the bank may comprises an attribute 
for controlling the intensity of the time lagged voice out- section (bank header) VH and a waveform section VB. 
puts, an adder 121b for mixing an output of the volume The waveform section VB contains compressed wave- 
device 120 with the original, not lagged voice outputs, 20 form data (referred to as the wave") and the bank 
and a master volume device 122 for controlling the header VH contains attribute data (referred to as an 
intensity of a mixture output of the adder 121b operate "attribute") attributed to the compressed waveform data 
to perform reverberation processing. (VAG). The attribute data need not correspond to the 

The sound source device is also adapted for mixing waveform data on a one-to-one basis. Preferably, a plu- 
the prescribed voice outputs with another audio signal 25 rality of attributes may be assigned to one single wave- 
retrieved from an optical disk and supplied by the form. Thus there is a greater number of attributes than 
decoder 82. More particularly, the SPU 71 further com- waveform data, as shown in Fig. 3. Also, the bank 
prises a switch 1 23 for selecting the mixing of the addi- header VH comprises a VAB header, a program header, 
tional audio signal from an optical disk having voice a tone attribute table (VAG attribute table), and a VAG 
outputs. A mixing volume device 124 controls the inten- 30 offset table, as shown in Fig. 4. The VAB header 
sity of the audio signal before transmission to an adder includes a VAB identifier for identifying thefile as a bank 
121a, and a switch 125 selectively subjects the audio VAB, a file ID for identifying each VAB file, a file size for 
signal to reverberation processing. representing a size of the file of bank VAB, a program 

The interconnection of the reverberation processor number for indicating the number of programs, a tone 

119. volume control 120, and mixing volume device 124 35 number for indicating the number of VAG attribute sets, 

shown In Fig. 2 are shown for the left channel. Similar a VAG number for showing the number of VAG data, a 

devices are connected for the right channel but are not master volume level ("mvoO for indicating a level of the 

shown in the illustration for the sake of clarity. master volume device 122, and a master pattern ("pan") 

Operation of the sound source device of the pre- for representing the master pan level, 

ferred embodiment will now be explained. When emis- 40 The program header includes a plurality of pro- 

sion of a sound is requested, the CPU 51 delivers a grams and the tone attribute table includes a plurality of 

selection signal for selecting and reading a waveform tone attributes. A group of the tone attributes (VAG 

corresponding to the sound together with a desired attributes) are assigned to each program in a given 

pitch of the sound from the sound buffer 72. This is then sound range. The program comprises a tone ("tone") 

transferred to the pitch shifter 111. The CPU simurtane- 45 indicating the number of the VAG attributes in the pro- 

ously retrieves an envelope corresponding to the gram, master volume ("vol") of the program, priority 

selected waveform from the main memory 53 and then ("prior") of the program, mode ("mode") of the sound 

transfers the sound to the envelope generator 115. In source, master pan level ("pan") of the program, 

response, the pitch shifter 111 performs reading of the attribute ("attribute") of the program, and addresses 

waveform by varying a waveform reading step with ref- so ("address 1,2"). 

erence to the pitch. Also, the pitch shifter 111, upon The VAG attribute comprises priority ("prior"), vol- 

completing the reading of the waveform of one period ume ("vol"), and panpot ("pan") of the VAG attribute, 

length, then repeats reading of the waveform so long as center note ("crsc") indicating a center tone of the 

emission of the sound is being requested. Subse- sound, fine tuning ("fine") for pitch correction, minimum 

quently, the waveform data of the pitch is produced ss and maximum ("min", "max") of the sound, width and 

while the request for the sound is being received. The period ("vibW", "vibT) of vibration, width and duration 

waveform data is supplied by the switch 1 1 4 to the enve- ("porW". "porT") of portamento, minimum and maximum 

lope generator 115. ("pbmin", "pbmax") of pitch bend for changing the pitch. 

settings ("adsr 1, 2") of envelope, program ("program") 
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including its VAG attributes, and identifier ("vag") for the 
(VAG) waveform data of the VAG attribute. 

The settings "adsr 1, 2" of the envelope indicate an 
attack ("attack"), decay ("decay"), hold ("sustain"), and 
release ("release") of the envelope, as shown in Fig. 5. 
The envelope generator 1 1 5 uses "adsr 1 , 2" for control- 
ling the output level of the pitch shifter 1 1 1 . As shown in 
Fig. 6, the envelope generator 1 15 comprises two "adsr" 

_ registers 115a and 115b for holding the envelope set- 
tings "adsr 1 , 2", an "adsr" controller 1 15c for determin- 
ing the amplitude of an output of the pitch shifter 1 1 1 

. according to "adsr 1, 2" from the "adsr registers 115a 
and 1 15b, and a multiplier 1 15d for calculating a product 
of the amplitude determined by the "adsr" controller 
1 1 5c and the output of the pitch shifter 111. In opera- 
tion, the CPU 51 reads from the main memory 53 
"adsrl" and "adsr 2" corresponding to a selected VAG 
attribute and transmits them to the "adsr" registers 1 1 5a 
and 1 15b respectively. At the same time, it instructs the 
sound buffer 72 to read a waveform according to the 
VAG attribute. The waveform read from the sound buffer 
72 is pitch shifted by the pitch shifter 111 and trans- 
ferred across the switch 1 14 to the multiplier 1 15d. The 
"adsr" controller 115c produces an envelope, shown in 
Fig 5, in response to "adsr 1 , 2" from the "adsr" registers 
1 15a and 1 15b and feeds it to the multiplier 1 15d. The 
multiplier 115 calculates a product of the output of the 
pitch shifter 1 1 1 and the envelope of the "adsr" control- 
ler 115c. 

More specifically, a resultant audio waveform is 
generated by amplitude modif ication of the output of the 
pitch shifter 1 1 1 with the envelope generator 115. This 
action will be repeated for each voice. The VAG offset 
table contains "vagooffset" values indicative of the loca- 
tion of each VAG in the waveform section VB. The 
"vagoffset" is an offset number counted from the front 
end of the waveform section VB representing the loca- 
tion of the VAG identified by "vag" of the VAG. In opera- 
tion, it is read out and sent by the CPU 51 to the SPU 
71. The SPU 71 retrieves the VAG as is controlled with 
"vagoffset" from the sound buffer 72d. In advance, the 
bank VAB data has been picked up from the optical disk 
and stored on the main memory 53 or sound buffer 72. 
The bank header VH is read from the optical disk and 
stored in the main memory 53 while the waveform sec- 
tion VB is retrieved from the optical disk and held in the 
main memory 53 before being transferred to the sound 
buffer 72 for storage. They can be read and transferred 
through DMA transfers. 

More specifically, the main memory 53 has a bank 
header storage area 53VH for storage of the bank 
header VH and a channel area 53c for transmission of 
the waveform section VB, as shown in Fig. 7. The chan- 
nel area 53c is smaller than the size of the waveform 
section denoted by the broken line of Fig. 7. The wave- 
form section VB is thus divided into segments which are 
smaller in size than the channel area 53c and stored in 
a succession into the channel area 53c before being 
transferred to the sound buffer 72. Accordingly, the 



channel area 53c of the main memory 53 for transmis- 
sion of the waveform data is minimized thus saving the 
storage area for game programs and contributing to the 
efficient use of the main memory 53. Also, the CPU 51 

5 reads but various attributes from the main memory 53 
and transfers them to the pitch shifter 1 1 1 , the envelope 
generator 115, the volume devices 117L and 117R for 
selection of the VAG and determining its relevant set- 
tings. As a result, the waveforms stored in the sound 

10 buffer 72 are called for and utilized for producing a 
sound of each voice. 

In this sound source device, the attribute and wave- 
form data are stored in the main memory 53 and the 
sound buffer 72 respectively. When generation of a 

75 sound is requested, its attributes are retrieved from the 
main memory 53 and using the attributes, the wave- 
forms are read from the sound buffer 72 to produce a 
sound signal. Because the attribute and waveform data 
from an optical disk are temporarily stored in the main 

20 memory 53 and sound buffer 72, they can easily be 
modified as desired. The sound reproduced is corre- 
lated with its image and provides BGM. 

The outputs of the envelope generator 115 and the 
two volume devices 1 1 7L and 1 1 7R can be controlled 

25 for left/right balancing not only with absolute values but 
also with a difference value between the two channels. 
This is done by a combination of the volume devices 
117L and 117R, each comprising a differential volume 
register 117a for holding a differential volume level, a 

30 volume register 117b for holding a volume level, an 
adder 117c, a limiter 117d, another volume register 
1 17e, and a volume controller 1 1 7f, as shown in Fig. 8. 

The volume devices 1 17L and 1 17R are preset by 
the CPU 51 which supplies the volume level and differ- 

35 ential level to the volume register 1 1 7b and the differen- 
tial register 117a respectively. As the volume level and 
differential level have been given, their sum is calcu- 
lated by the adder 1 1 7c at equal intervals of a clock sig- 
nal and then transmitted to the limiter 11 7d and the 

40 volume register 1 1 7e. A sum of the volume level and the 
differential level is supplied to and held by the volume 
register 117b. Their sum is calculated upon delivery of 
the following clock pulse. As the differential volume level 
is being held, it is added to the volume level at each 

45 interval of the clock signal and the resultant sum output 
is varied continuously. For example, when the differen- 
tial level is a positive value, the volume output will con- 
tinuously be increased and when it is a negative value, 
the output will be decreased gradually. 

so The volume sum is then fed to the limiter 117d 
where it is limited and transferred to the volume register 
117e. The volume controller 117f calculates a product 
of the output of the envelope generator 115 supplied 
across the mute processor 116 and the volume sum 

55 stored in the volume register 1 17e and sends it to the 
adder 121a. Accordingly, the output of the envelope 
generator 115 can be controlled to a desired volume 
level. Because the input of the volume level is controlled 
continuously, the output of the envelope generator 115 
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varies in succession. More particularly, if the differential 
volume level is set from time t1 to t2 as shown in Fig. 
9(c), the volume sum will increase at a rate of dv/dt as 
shown in Fig. 9(b). Consequently, the volume controller 
117f delivers a continuously increasing waveform 5 
shown in Fig. 9(a). This results in a continuous change 
in the reproduced sound and the generation of 
unwanted artifacts such as pop noise caused by discon- 
tinuous change is avoided. Also, because the volume 
output is gradually varied in proportion to the differential n 
volume level, the setting of their values by the CPU 51 
may be executed only once thus minimizing the load on 
the CPU 51. 

It is understood that if the differential volume level is 
not given, the control of the volume device 1 17b by the is 
adder 1 17c fails to be updated. With the volume level 
assigned to a constant value, the volume devices 1 17L 
and 117R remain functioning as common resistors. 
Also, because the clock signal for controlling the adder 
1 17c is given at equal intervals of a time, it may be var- 20 
ied by predetermined settings of the SPU 71 . A change 
in the interval between two clocks can be controlled bv 
the CPU 51. 

When the clock signal is introduced at equal inter- 
vals of time and the cfifferential volume level is a positive 25 
value, the output level of the volume controller 117f 
increases linearly at a given rate as denoted by (a) in 
Fig. 10. If the differential volume level is a negative 
value, the output level is linearly decreased as denoted 
by (b) in Fig. 10. When the interval between the two so 
clocks is continuously decreased with the differential 
volume level being a positive value, the output level of 
the volume controller 117f decreases nonlinearly or 
under an exponential function as denoted by (c) in Fig. 
10. If the interval between two clocks is decreased in 35 
steps with the differential volume level being a positive 
value, the output level of the volume controller 1l7f 
increases according to a quasi-exponential function 
curve where the increment is gradually decreased as 
denoted by (d) in Fig. 10. As the output of the volume 40 
controller H7f is increased or decreased in an expo- 
nential function relationship, the change in the produced 
sound will be moderate and favorable to human ear per- 
ception even though the increment is made in steps as 
denoted by (e) in Fig 1 0. This attenuates the generation 45 
of pop noises in the reproduced sound. 

It is essential for the sound source device that the 
sound source controlling program be carried out by the 
CPU 51 . In a video-game machine, a variety of audio 
data including waveforms, tones, pitch, emission, termi- so 
nation, types, and others of special effects and BGM 
sounds are stored in the form of scores along with time 
data in the main memory 53. The audio data contained 
in scores are retrieved at equal intervals of time in a 
given sequence and used to assign the actions of pitch, 55 
emission, and termination registers which in turn pro- 
duce a desired special effect or BGM sound. The score 
audio data is classified into either single score data con- 
sisting of a file of score data for playing a sequence of 



music, or joined score data consisting of a file for play- 
ing multiple sequences. As shown in Fig. 11, the single 
score data comprises a file header and score data of 
one sequence. The score data of one sequence 
includes a data header representing attributes of the 
score data and sequence information. The file header 
consists of a sound ID identifying the file as a sound 
data file and a version number identifying the version. 

The data header information includes time resolu- 
tion and 1/4 note resolution with tempo and beat of the 
score data, and tempo and beat of the music. The 
sequence information contains sound data representing 
multiple sounds in one sequence. As shown in Fig. 12, 
the joined score data comprises a file header and score 
data of multiple sequences. Similar to the single score 
data, the score data of each sequence includes data 
header information representing attributes of the score 
data and sequence information. 

The data header information of the joined score 
data consists of a score data ID identifying the type of a 
score data which is followed by time resolution and 1/4 
note resolution with tempo and beat of the score data, 
and tempo and beat of music. As shown in Fig. 13, the 
sequence information in the joined score data contains 
key-on for starting a voice, key-off for terminating the 
voice, and pitch attribute change data for shifting the 
tone of a voice. This data is interpreted by the CPU 51 
and used for controlling the sound source device as 
described above. The single or joined score data is 
based on score data of each sequence, as shown in 
Fig. 14. 

For example, the single score data is composed of 
one score data A or B accompanied with its file header. 
Also, a joined score data P is constructed by joining 
score data C, D, and E with their respective score data 
IDs P-1 , P-2, and P-3 and accompanying them with the 
file header. The score data IDs are aligned in order in 
the joined score data P. The single or joined score data 
stored in an optical disk is retrieved in advance for stor- 
age in the main memory 53. In processing, the single or 
joined score data is called for by the CPU 51 and repro- 
duced by operation of the sound source controller 
implemented by the sound source controlling programs. 

The sound source controller may comprise the cir- 
cuitry arrangement shown in Fig. 15 where either single 
or joined score data is used for controlling the sound 
source of the device. As shown, the sound source con- 
troller comprises an input device or controller 92, a 
score data selector 105 for selecting a desired one to be 
played back from a group of single or joined score data 
stored in the score data storage area 53a of the main 
memory 53. A score data acquisition unit 106 acquires 
the selected score data identified by the score data 
selector 105. An emission/termination data controller 
1 07 controls the sound source or sound module 70. The 
score data selector 105 comprises a score data selec- 
tion administrator 105a which is responsive to an input 
from the input devices 92 for administering the score 
data to be selected. A score data selection storage 
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105b holds the contents of the score data, and a score 
data selection controller 105c analyzes the contents of 
the score data held in the score data selection storage 
105b. 

The single score data A, B and the joined score 
data P have their file headers deleted and are stored 
independently in the score data selection storage 53a, 
as show in Fig. 16. Meanwhile, as score IDs 4 and 5 are 
assigned to their respective single score data A and B, 
they define the address in the score data selection stor- 
age 105b. Also, the score data C, D p and E of the joined 
score data P are accompanied with their respective 
score IDs 1, 2, and 3 and are stored at corresponding 
address locations as determined by the IDs. More spe- 
cifically, address and pointer data identifying the storage 
locations of the score data are stored in a reference 
table of the main memory 53, as shown in Fig. 1 7(a). As 
shown, the reference table may be designed for assign- 
ing the score IDs 4 and 5 in the single score data A and 
B to two address locations ADDR1 and ADDR2 respec- 
tively, and to two pointers pt4 and pt5. Also, the score 
IDs 1, 2, and 3 of their respective score data C, D, and 
E in the joined score data P-1, P-2, and P-3 are 
assigned to three pointers pt1, pt2, and pt3 respectively 
in the reference table. 

A start address reference table is also stored in the 
main memory 53. The letter P represents the score data 
ID assigned to start address SADDR1 where the joined 
score data P is saved, as shown in Fig. 17(b). Similarly, 
an offset address reference table is stored in the main 
memory 53, which assigns P-1, P-2, and P-3 of the 
score data ID to three different offset addresses respec- 
tively in relation to SADDR of the joined score data P, as 
shown in Fig. 17(c). For example, the offset address of 
P-1 is 0 because its score data C comes first in the 
joined score data. The offset addresses of P-2 and P-3 
are thus OADDR1 and OADDR2 starting from SADDR 
of the score data D and E respectively The score data 
in the single or joined score data can easily be read out 
by simply examining its score ID with reference to the 
reference table, start address reference table, and off- 
set reference table. Fig. 18 illustrates operation of this 
system where any score data in the joined score data 
can be retrieved by specifying its score ID with much 
ease as compared with reading the address directly. 

In the sound source controller, 24 voices in the 
sound source are allocated to a group of the score data 
respectively for reproduction. The reproduction of each 
score data is guided by a pointer on the reference table 
of the score data. The pointer points out the location of 
the score data during the reproducing process and it 
remains at the head of the score data when no repro- 
duction is requested. 

In the score data storage 105b, some reproducing 
states of the score data corresponding to the numbers 
of the score ID are listed in a score data selection 
attribute table as shown in Fig. 19. The reproducing 
states are determined by setting commands from the 
input device 104 or from other programs. The reproduc- 
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ing state is identified as "stop" when no reproducing 
action is executed, "play" during the reproducing proc- 
ess, and "pause" when the reproducing process is tem- 
porality stopped. In the score data selection attribute 

5 table of Fig. 1 9, the score ID 1 represents the score data 
being reproduced, the score ID 2 indicates no reproduc- 
tion of the score data, the score ID 3 is the score data 
being paused, the score ID 4 is the score data being 
reproduced, and the score ID 5 indicates that there is no 

10 reproduction of the score data. The reproducing proc- 
ess of a score data in a playback device will now be 
explained referring to the flow chart of Fig. 20. 

When reproduction of the score data is requested, 
the procedure begins with Step S1 where the score data 

15 selection administrator 105a examines whether or not 
input from the input device 104 is provided. If there is 
input, the procedure moves to Step S2 and if not, the 
system continues with Step S6. In Step S2, the score 
data selection controller 105c examines whether or not 

20 the input represents a request with the score ID for 
reproducing its score data. If there is no request, the 
procedure goes to Step S4. if there is a request, the pro- 
cedure advances to Step S3 where the state of the 
score data is turned to "play* as specified by the score 

25 ID in the score data selection storage 105b. in Step S4, 
the score data selection controller 105c examines 
whether or not the input represents a request for the 
score ID to stop its score data. If not, the procedure 
goes to Step S6 and if yes, it advances to Step S5 

30 where the state of the score data is shifted to "stop" as 
specified by the score ID in the score data selection 
storage 105b before moving to Step S6. The score data 
selection controller 105c analyses the state of the score 
data specified by the score ID of the score data selec- 
ts tion storage 105b at Step S6. Then, it is determined in 
Step S7 whether or not the score ID is "play". If not. the 
procedure returns to Step S1 and waits for introduction 
of another input. If the "play" score ID is present at Step 
S7, the procedure goes to Step S8 to start reproduction 

40 of the score data specified by the score ID. 

The procedure after S8 is carried out on a score- 
data-by-score-data basis and is controlled by timer 
interrupt signals generated at equal intervals of time by 
the peripheral device controller 52. The description of 

45 this operation will be made with respect to one example 
of the score data. In Step S8, the score data acquisition 
unit 1 06 instructs the score data storage 53a to read rel- 
evant score data specified by the "play" score ID. The 
score data acquisition unit 106 examines whether or not 

so the score data ends at Step S9. If it does end in step S9, 
the sound processing is terminated and if not, the pro- 
cedure goes to Step S10. 

In Step S10, the score data acquisition unit 106 
examines whether or not the score data retrieved in 

55 Step S9 is the correct one to be reproduced during the 
current interrupt duration. If not, the sound processing 
will be ceased. If yes, the procedure moves to Step S1 1 . 
In Step S11, the sound emission/termination controller 
107 examines whether or not the score data to be repro- 
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duced in the current interrupt duration includes "key- 
on". If not the procedure goes to Step S13. If yes, the 
procedure advances to Step S12 where an instruction 
for emitting a corresponding voice is given to the sound 
source and moves back to Step S8 to stand by for the 5 
next interrupt signal. 

The sound emission/termination controller 107 
examines whether or not the score data to be repro- 
duced in the current interrupt duration includes "key-off 
at Step S13. If not the procedure goes back to Step S8 10 
to wait for the next interrupt signal. If yes, the procedure 
advances to Step S14 where an instruction for terminat- 
ing a corresponding voice is given to the sound source 
and returns back to Step S8 to stand by for the next 
interrupt signal. In this manner, the score data specified is 
by a selected score ID is reproduced with the use of the 
score data selection attribute table. 

In the sound source controller, any score data is 
easily identified by examining its score ID with reference 
to the reference tables and the control of the score data 20 
will be simplified. Because the reproducing state of the 
score data with its score ID is independently determined 
by modifying the contents of the score data selection 
attribute table, the reproduction of one score data can 
be implemented regardless of the reproduction states of 25 
the remaining score data. This allows the response to a 
request from the operator or a demand from the other 
program to be increased in speed. 

The sound source controller shown in Fig 15 also 
includes the circuitry arrangement shown in Fig. 21 . Fig. 30 
21 is a block diagram representation of a sequence of 
actions controlled by the CPU 51 operating in accord- 
ance with the operating system, sound source control 
program, and game programs. The sound source con- 
troller includes a timer interrupt controller 1 30 for gener- 35 
ating timer interrupt signals to the CPU 51 at equal 
intervals of time. Actions of the peripheral device con- 
troller 52, and sound controller 140 are responsive to 
timer interrupt actions of the peripheral device controller 
52 for controlling the action of the sound source accord- 40 
ing to the score data. A system load controller 150 
examines the load on the entire video-game machine. 
The system load controller 150 feeds Hs information to 
the timer interrupt controller 130, and an input request 
controller 1 60 for checking the action of the controller 92 45 

A drawing controller 170 controls drawing actions of 
the graphic module 60, and a main routine 180 
responds to commands from the operator for controlling 
a sequence of game actions with a corresponding emis- so 
sion of special effects sounds, music and the display of 
images. These are controlled by the CPU 51 and are 
performed simultaneously with the actions of the sound 
controller 140 according to the operating system and 
game program. The timer interrupt controller 130 com- ss 
prises a timer interrupt interval storage 131, a timer 
interrupt controller 132, and a control selector switch 
133 for switching for action between the sound control- 
ler 140 and the main routine 180. 



The sound controller 140 comprises, in addition to 
the sound source 70, a score data storage 141 for hold- 
ing the score data, a data acquisition controller 142 for 
controlling the retrieval of the score data, a time control- 
ler 143 for controlling the action of the data acquisition 
controller 142, a sound emit/terminate controller 144 for 
controlling the emission and termination of sounds 
according to the score data, and an internal resolution 
storage 145 for holding internal resolution data corre- 
sponding to the timer interrupt interval data of the timer 
interrupt interval storage 131. The sound source 70 
includes the SPU 71 and the sound buffer 72. More spe- 
cifically, it comprises a sound emitter 147 responsive to 
an command from the sound emit/terminate controller 
144 for reading a corresponding waveform from the 
sound buffer 72 or waveform storage 1 48, and an ampli- 
fier 148 for amplifying the waveform of the sound emitter 
147. The sound emitter 147 and the amplifier 148 are 
actually provided as one unit of the SPU 71 . 

The system load controller 150 comprises a system 
load acquisition 151 for acquiring system load data and 
a system load examiner 152 for examining the system 
loading data. A system load threshold storage 153 
holds the thresholds of the system load data. The input 
request controller 160 comprises an input device 161 
including the controller 92, and an input request ana- 
lyzer 162 for analyzing an input request. The drawing 
controller 170 is a combination of the CPU 51, the GTE 
61, the GPU 62. and the frame buffer 63. More specifi- 
cally, it comprises a during-control drawing data storage 
1 71 including the GTE 61 , a drawing data controller 1 72 
including the CPU 51, a drawing device 173 including 
the GPU 62, a drawing data storage 174 including the 
frame buffer 63, and a display device 175 for displaying 
an image derived from a video output of the drawing 
device 1 73. The operation of the sound source control- 
ler will be explained in more detail below. 

In the sound source controller, the timer interrupt 
interval data corresponding to system loads or request 
inputs are stored in the timer interrupt interval storage 
131. For example, the timer internet interval data 
includes an interval of 1/240 second assigned to lower 
system loads and 1/60 of a second assigned to higher 
system loads which is longer than the interval at the 
lower system load. As the sound source controller is 
started, the main routine 180 while under controlled of 
the CPU 51 operates in parallel a group of actions for 
controlling the drawing controller 170 according to com- 
mands from the input device 161. The selecting of 
sounds is determined by the sound controller 140, and 
actuating the system load controller 150. The system 
load acquisition 151 receives load data from the CPU 
51 and delivers it to the system load examiner 152. The 
system load examiner 152 examines the system load by 
comparing it with threshold values stored in the system 
load threshold storage 153 and delivers its comparison 
result to the timer interrupt interval storage 131 . 

The timer interrupt interval storage 131 determines 
a corresponding length of the timer interrupt interval 
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from the result output of the system load examiner 152 
or an output of the input request analyzer 162 and trans- 
fers it to the timer interrupt controller 132 and the inter- 
nal resolution storage 145. More particularly, the timer 
interrupt interval storage 131 selects an interval of 
1/240 second when the system load is low as judged by 
the system load examiner 152 and an interval of 1/60 of 
a second when the system load is high. The timer inter- 
rupt controller 132 controls the peripheral device con- 

" troller 52 according to the timer interrupt interval from 
the timer interrupt interval storage 131. This results in 
the production of timer interrupt signals at equal inter- 

* vals of the time. The control selector switch 133 actu- 
ates the main routine 180 and the sound controller 140 
alternately at the equal intervals. This allows the sound 
controller 143 to perform its sound producing process. 

Because the sound controller 140 is actuated by 
the switching action of the control selector switch 133, 
the time controller 143 according to the timer interrup- 
tion interval or internal resolution stored in the internal 
resolution storage 145 instructs the data acquisition 142 
to read out a timer interrupt interval length of the score 
data from the score data storage 1 41 and transmits it to 
the sound emit/terminate controller 144. The sound 
emit/terminate controller 144 controls the action of the 
sound emitter 1 47 in response to the length of the score 
data from the time controller 143. Accordingly, the 
sound emitter 147 produces a sound having a corre- 
sponding waveform selected from the waveform storage 
146. More specifically, while the sound emitfterminate 
controller 144 is being actuated, the CPU 51 deter- 
mines the action of the pitch shifter 111 and the enve- 
lope generator 115 for producing a requested sound. 
The sound is then adjusted in amplitude by the amplifier 
1 48 before being transferred to the loud speaker 73 for 
acoustic output. The sound is created by an audio sig- 
nal of the score data for a length of the timer interrupt 
interval released from the timer interrupt interval stor- 
age 131. 

Because the sound controller 140 is actuated by 
the timer interrupt intervals which are determined by the 
timer interrupt interval storage 131, the timer interrupt 
interval lengths of the score data are released in suc- 
cession. When the timer interrupt interval is 1/240 of a 
second, a 1/240-second length of the score data is 
reproduced as shown in Fig. 22(a). 

At that time, the actual processing duration in the 
sound controller 140 is much smaller than 1/240 sec- 
ond. For example, two notes are played during a period 
from t1 1 to t12, from t12 to t13, from t13 to t14, or from 
t14 to t15. A total of 8 notes are reproduced in 1/60 of a 
second from t1 1 to t15. When the timer interrupt interval 
is 1/60 of a second, a 1/60-second length of the score 
data is reproduced as shown in Fig. 22(b). Then, eight 
notes are played in 1/60 second from t21 to t22. Eight 
notes are played in the same length when the timer 
interrupt interval is either 1/240 or 1/60 of a second. 
Accordingly in the sound source controller, even if the 
timer interrupt interval is varied, the reading of the score 



data is controlled to match the interval. This allows the 
score data to be retrieved and played back at the same 
tempo. When the timer interrupt interval is 1/240 of a 
second, the action of the sound controller 140 triggered 

s by the timer interrupt interval signal claims about 25 % 
of the full load of the CPU 51 as shown in Fig. 23(a). 
However, when the timer interrupt interval is 1/60 of a 
second, the action of the sound controller 140 is as 
small as 12.5 % of the processing capability of the CPU 

io 51 as shown in Fig. 23(b). 

It is clear that the load to the CPU 51 for controlling 
the action of the sound source hardly varies when the 
timer interrupt interval is decreased in length. However, 
when the timer interrupt interval is very short, the inter- 

15 rupt action more frequently occurs and the overhead for 
introducing an interruption is increased. This results in 
increase of the load to the sound controller 140. There- 
fore, the timer interrupt interval which is predetermined 
and stored in the timer interrupt interval storage 131 is 

20 selected to be 1/240 of a seoond when the system load 
is relatively low, allowing the sound controller 140 to 
handle more loads. It is selected to be 1/60 of a second 
when the system load is high, thus decreasing the load 
of the sound controller 140. 

25 As a result, the processing capacity of the sound 
controller 140 in the sound source controller of the 
present invention is varied depending on the system 
load without changing the form of the score data. When 
the system load is very great, the sound controller 140 

30 is less of a load to allow smooth processing of video 
data for drawing. 

Tile foregoing embodiment of the present invention 
is not limited to the sound source device installed in a 
video-game machine for producing effect sounds and 

35 music but is applicable to any device, such as an auto- 
matic player or microcomputer, in which sounds are pro- 
duced by adjusting the amplitude of a waveform 
according to predetermined amplitude data. It is also 
understood that other changes and modifications are 

40 possible without departing from the technological princi- 
ples of the present invention. 

As set forth above, the sound source device of the 
present invention allows a setting of the volume level to 
be varied according to a differential volume data which 

45 is predetermined and loaded so that the output of the 
pitch shifter can continuously be changed in amplitude. 
Subsequently, a resultant sound signal remains not dis- 
continuous thus attenuating undesired noise in a repro- 
duced sound. Because the volume level is gradually 

so varied depending on the differential volume value, the 
sound source controller for controlling the action of the 
sound source is only once loaded with initial settings of 
the volume level and differential volume value. This 
allows the load of the sound source controller to be min- 

55 imized. 

The present invention is subject to many variations, 
modifications and changes in detail. It is intended that 
ail matter described throughout the specification and 
shown in the ;accompanying drawings be considered 
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illustrative only. Accordingly, it is intended that the inven- 
tion be limited only by the spirit and scope of the 
appended claims. 

Claims 

1 . A sound source device comprising : 

a waveform buffer for storage of waveform 

data; 

a pitch converter means for reading out the 
waveform data from the waveform buffer and 
changing a pitch of the waveform data in accord- 
ance with pitch data; 

an amplitude memory for holding amplitude 
data; and 

a level controller for receiving an output of 
the pitch converter and adjusting a level of the out- 
put from the pitch converter based on the amplitude 
data to provide an adjusted output. 



2. The sound source device of claim 1, further com- 
prising: 

a differential amplitude memory for storing 
differential amplitude data; and 

a level modifying means for changing the 
amplitude data held in the amplitude memory 
based on the differential amplitude data held in the 
differential amplitude memory. 

3. The sound source device of claim 1 , wherein a level 
of the adjusted output changes gradually. 

4. The sound source device of claim 3. wherein a level 
of the adjusted output changes in accordance with 
a linear function. 

5. The sound source device of claim 3, wherein a level 
of the adjusted output changes in accordance with 
an exponential function. 

6. The sound source device of claim 2, wherein the 
level controller comprises a further memory means 
for storing further amplitude data and an adder for 
adding the further amplitude data to the differential 
amplitude data. 

7. The sound source device of claim 1 , further com- 
prising a means for reverberating the adjusted out- 
put. 

8. The sound source device of claim 1 , further com- 
prising a means for sensing a load on a CPU asso- 
ciated with the sound source device. 

9. A method of producing an audio signal comprising 
the steps of: 

providing waveform data; 
changing a pitch of the waveform data to 
provide a pitch converted output; and 
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adjusting a level of the pitch converted out- 
put based on the amplitude data held in an ampli- 
tude memory to provide an adjusted output. 

10. The method of producing an audio signal of claim 9, 
further comprising a step of changing the amplitude 
data in the amplitude memory based on differential 
amplitude. 

11. The method of producing an audio signal of claim 9, 
wherein the adjusted output changes gradually. 

1 2. The method of producing an audio signal of claim 9, 
wherein the adjusted output changes in accordance 
with a linear function. 

1 3. The method of producing an audio signal of claim 9, 
wherein the adjusted output changes in accordance 
with an exponential function. 



3CID: <EP 0729131 A2J_> 



12 



EP 0 729 131 A2 



61 

51 

52- 

53 
54 



GTE 



CPU 



PERIPHERAL 
CONTROLLER 



MAIN 
MEMORY 



ROM 



50 



101- 
102- 



PIO 



SIO 



■100 



GPU 



I 



62 



FRAME 
BUFFER 



63 



IMAGE 
DECODER 



V 

\f 64 



,-60 



_0 VIDEO 
^ OUTPUT 



SPU 



r /7 











-70 

Ar73 



72 



SOUND 
BUFFER 



DECODER 



BUFFER 



82 
83 



o 



■80 



81 \ 



OPTICAL 
DISK 



COMMUNICATION 
CONTROLLER 

1 

91 




....\ r 90 



CONTROLLER 



93 



MEMORY 
CARD 



FIG.1 



SDOCID: <EP 0729131 A2_l. 



13 



EP 0 729 131 A2 



Q. 

O 




CM 

(5 



qOC 

ziii 

COflQ 



So 



CO 



o 
o 

-J 

o 



OQ 

oco 

0 UJ 



00 



UJ 

xO 



3 

O 



14 



XCID: <EP 0729131A2_I_ 



EP 0 729 131 A2 




3DOCID. <EP 072S131A2J_> 



15 



EP 0 729 131 A2 




OCID: <EP 0729131A2J_> 



16 



EP0 729 131 A2 



LEVEL 




ENVELOPE 



FIG.5 



115 



115a 



CPU 

i 
t 
i 

! 



115b 



JL 



adsr 1 



^ adsr 2 ^ 



SWITCH 

114 




115c 



SWITCH 

116 



FIG.6 



5DOCID: <EP 07291 31 A2_l_> 



17 



EP 0 729 131 A2 



MAIN 
MEMORY 



53 



GAME 
PROGRAM 



VH 



■53vh 



SOUND 
SOURCE 
PROGRAM 




53c 



..SIZE OF 
VB 



FIG.7 



18 



EP 0 729 131 A2 



117b 



VOLUME 
REGISTER 



MUTE 
PROCESSOR 

116 



117a 



DIFFERENTIAL 
VOLUME 
REGISTER 



dv 




117c 



LIMITER 



VOLUME 
REGISTER 



VOLUME 
CONTROLLER 



1176 



117e 



ADDER 

121a 



117f 



FIG.8 



19 



EP 0 729 131 A2 





OCID: <EP 0729131A2J_> 



20 



EP 0 729 131 A2 




EP 0 729 131 A2 



SCORE / 
DATA * 



SOUND ID 



VERSION NO. 



ATTRIBUTE 



RESOLUTION OF 
QUARTER NOTE 



TEMPO 



BEAT 



MUSIC DATA 



END OF FILE 



FILE HEADER 
INFORMATION 



s DATA HEADER 
INFORMATION 



SEQUENCE 
DATA 



FIG.11 



DC ID: <EP 072S131A2_I_> 



22 



EP 0 729 131 A2 



SCORE7 
DATA A 



score; 

DATA \ 



SOUND ID 


VERSION NO. 


ATTRIBUTE 


SCORE 

DATA ID | 


RESOLUTION OF 
QUARTER NOTE 


TEMPO 


BEAT 


DATA SIZE 


MUSIC DATA 


END OF FILE 


ATTRIBUTE 


SCORE DATA 
ID 


RESOLUTION OF 
I QUARTER NOTE 


TEMPO 


BEAT 


DATA SIZE 


MUSIC DATA 


END OF FILE 







FILE HEADER 
INFORMATION 



DATA 
HEADER 
INFORMATION 
1 



SEQUENCE 
DATA 1 



DATA 
HEADER 
INFORMATION 

2 



SEQUENCE 
DATA 2 



FIG.12 



23 



EP 0 729 131 A2 




OCID: <EP 07291 31 A2_l_> 



24 



EP 0 729 131 A2 



SCORE 
DATA A 



SCORE 
DATAB 



SCORE 
DATAE 



SCORE 
DATA D 



SCORE 
DATA C 



FILE HEADER 
INFORMATION 



SCORE 
DATA A 




FILE HEADER 
INFORMATION 



SCORE DATA ID 
P-1 



SCORE DATA C 



SCORE DATA ID 
P-2 



SCORE DATA D 



SCORE DATA ID 
P-3 



SCORE DATA E 



T 
p 



FILE HEADER 
INFORMATION 



SCORE 
DATA B 



■B 



FIG.14 



25 



EP 0 729 131 A2 



704- 



INPUT 
DEVICE 



92 



105 



SCORE DATA SELECTOR 



SCORE 
DATA 
SELECTION 
ADMINISTRATOR 



I 



SCORE 
DATA 
SELECTION 
STORAGE 



SCORE 
DATA 
SELECTION 
CONTROLLER 



105a 



105b 



105c 



SCORE 
DATA 
STORAGE 



SOUND 
EMIT/ 
TERMINATE 
CONTROLLER 



53a 



70 



SCORE 
DATA 
ACQUISITION 



107 



SOUND 
SOURCE 



1 

106 



FIG.15 



26 



EP 0 729 131 A2 




53a 




SCORE DATA ID 
P-1 



SCORE DATA C 



SCORE DATA ID 
P-2 



SCORE DATA D 



SCORE DATA ID 
P-3 



SCORE DATA E 



T 
p 



FIG.16 



27 



EP 0 729 131 A2 



LU 

-J 

00 
< 



UJ 



POINTER 






CO 


3 














CL 
















ADDRESS 




I 




ADOR1 


AODR2 




9 




























Q 


T— 

I 


CJI 


2 


i 


i 




SCORE 


Q. 


a 










o 














in 
cc 




CM 


CO 








)0S 















< 

d 
u. 



UJ 

m 

< 

UJ 
O 

UJ 

cc 

UJ 

u. 

UJ 

cc 

LU 
CO 



to 










V) 










UJ 










cc 










Q 






CM 




Q 




cc 


CC 




< 




o 


Q 








Q 


a 




1— 
UJ 




< 


< 




CO 


o 


o 


o 




LO- 










LL 










o 










o 










< 










1- 










DA 






7 




UJ 


CL 


Ql 


CL 




cc 










o 










o 










CO 











o 
d 



UJ 










— I 


CO 








CQ 


CO 








< 


UJ 








ET 


ADDR 


cc 


CM 
CC 




o 


o 


o 






Q 


Q 




UJ 


i- 


< 


< 




cc 


cc 


CO 


CO 




UJ 


< 








u. 


1- 








UJ 


co 








cc 










SS 


a 








•DRE 


ATA 








IT AD 


RE D, 


CL 


o 




STAR 


SCOI 









CQ 

u. 



OCID: <EP 0729131A2J_> 



28 



EP 0 729 131 A2 




SDOCID: <EP 07291 31 A2_l_> 



29 



EP 0 729 131 A2 



( 



SCORE 
ID 


STATE OF 
SCORE DATA 






1 


PLAY 


STATE 
SETTING 




2 


STOP 


INPUT FROM 
USER OF 
PROGRAM 


3 


PAUSE 




4 


PLAY 






5 


STOP 







FIG.19 



X3CJD: <EP 0729131A2_I_> 



30 



EP 0 729 131 A2 




= U- W ZC0 



tcos<< 




S<2ko 




UJO' 

LU UJ 



o 




CM 

d 



SDOCID: <EP 07291 31 A2J_> 



31 



EP 0 729 131 A2 



80 



EXTERNAL 
STORAGE 



140 

-A. 



SOUND 
CONTROLLER 



53e 
142 "l 



170-x. 



172 



1 



DRAWING 
CONTROLLER 



171 



DRAWING 
INFORMATION 
CONTROLLER 



60 

173- 



61 



CONTROLLED 
DRAWING 

INFORMATION 
STORAGE 



DRAWING 



175 



DISPLAY 



174 



DRAWING 
INFORMATION 
STORAGE 

T- 

63 



DISPLAY 
UNIT 



150 v 



SYSTEM 
LOAD 
CONTROLLER 



141 



MUSIC 
DATA 
STORAGE 



DATA 
ACQUISITION 
CONTROLLER 



143 



106 



105 



151 



152 



153 



SYSTEM LOAD 
INFORMATION 
ACQUISITION 



T 



input" 1 1 ?° 

REQUEST v 
CONTROLLER 

92 A 



161 



INPUT 
DEVICE 

T 



SYSTEM LOAD 
EXAMINER 



SYSTEM LOAD 
THRESHOLD 
STORAGE 



— 1 j 



TIME 



CONTROLLER — RESOLUTION 
UONT HOLLER STORAGE 



INTERNAL 



SOUND 
EMIT/ 
TERMINATE 
CONTROLLER 



147 



144 



107 



SOUND SOURCE 



SOUND 
EMITTER 



~7 

145 



70 

r 

-• i '-< 
72 \ 



WAVEFORM 
STORAGE 



AMPLIFIER 



71 

^148 



146 



1 



131 



INPUT 
REQUEST 
ANALYZER 



162 J 



L__ 1 



■r — - r 



TIMER 
INTERRUPT 
INTERVAL 
STORAGE 



132 



133 



TIMER 
INTERRUPT 
CONTROLLER 



T 



CONTROL 
SELECTOR 
SWITCH 



TIMER 
INTERRUPT 
L CONTROLLER \ 



MAIN 
ROUTINE 
"7 

180 



130 



FIG.21 



32 



OCID: <EP 0729131A2J_> 



EP 0 729 131 A2 




< 

CM 
CM 

O 

ij- 



cd 

CM 
CM 

CD 
LL 



SDOCID: <EP 07291 31 A2_l_> 



33 



EP 0 729 131 A2 



INTERRUPT INTERVAL 
1/240 SECOND 



ACTION 

AT 
SOUND 
CONTROLLER 



OTHER 
ACTIONS 



0% 



30% 



50% 



LOAD FOR ACTION 

FIG. 23 A 



100% 



ACTION , 
AT J 
SOUND 
CONTROLLER 



INTERRUPT INTERVAL 
1/60 SECOND 



0% 12.5% 



OTHER 
ACTIONS 



50% 

LOAD FOR ACTION 



100% 



FIG.23B 



DOCID: <EP 0729131 A2_l_> 



34 



EP 0 729 131 A2 



r 201 r 202 r 203 





MAIN 
CPU 




SOUND 
SOURCE 




IMAGE 
DISPLAY 
















1^207 
















MEMORY 




OPTICAL 
DISC 




INPUT 
DEVICE 




^204 


1205 


^206 



FIG.24 



SDOCID: <EP 07291 31 A2J_> 



35 



EP 0 729 131 A2 




in 

CM 

d 



^OCID: <EP 0729131 A2_L> 



36 



EP0 729 131 A2 



FIG.26A 



FIG.26B 




VOLUME/ 
PITCH SETTING 



FIG.26C 



t30 



ISDOCID: <EP 0729131A2_L> 



37 



r' 

,;. ■ . ■ ■ / . ■■ 




f 




i 



'■4 



(19) 



J 



(12) 



(88) Date of publication A3: 

13.01.1999 Bulletin 1999/02 

~(43) Date of publication A2: 

28.08.1996 Bulletin 1996/35 

.(21) Application number: 95118900.0 

(22) Date of filing: 30.1 1 .1 995 



EuropSisches Patentamt 
European Patent Office 
Off ice europSen des brevets (11) EP 0 729 131 A3 

EUROPEAN PATENT APPLICATION 

(51) int. CI. 6 : G10H 1/00, G10K 15/02 



(84) 


Designated Contracting States: 


• Suzuokl, Masakazu, 




DE DK FR GB NL 


c/o Sony Corp. 






Tokyo (JP) 


(30) 


Priority: 02.12.1994 J P 300032/94 








(74) Representative: 


(71) 


Applicant: SONY CORPORATION 


Muller, Frithjof E., Dipl.-lng. et al 




Tokyo (JP) 


PatentanwSlte 






WlOLLER & HOFFMANN, 


(72) 


Inventors: 


Innere Wiener Strasse 17 


• 


Furuhashi, Makoto, 


81667 Munchen (DE) 




c/o Sony Corp. 




Tokyo (JP) 





(54) Electronic sound source having reduced spurious emissions 



(57) An electronic sound source comprises an 
adder which calculates a sum of volume data and differ- 
ential volume data in response to each clock signal sup- 
plied at equal intervals of time and transfers it to a limrter 
and a volume register. The sum volume data is then lim- 



ited to a predetermined value by the limrter and passed 
across a volume register to a volume controller where it 
is multiplied by an output of a mute processor. 



CPU 



CO 
< 

CO 

o> 

CM 




FIG.2 



Q. 
LU 



SDOClD: <EP 07291 31 A3_L> 



Primed by Xerox (UK) Business Services 
2.16.7/3.6 



EP 0 729 131 A3 



J 



European Patent 
Office 



EUROPEAN SEARCH REPORT 



Application Number 

EP 95 11 8900 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Category 



Citation of document with indication, where appropriate, 
of relevant passages 



Relevant 
to claim 



CLASSIFICATION OF THE 
APPLICATION (lnLCI.6) 



s 
I 



US 5 283 387 A (TANAKA KIKUJI) 
1 February 1994 

* column 1, line 61 - column 2, line 

* column 6, line 59 - column 7, line 

* figure 6 * 



11 

25 



US 5 111 530 A (KUTARAGI KEN ET AL) 
5 May 1992 

* column 5. line 63 - column 6, line 31 * 

* column 8. line 10 - line 22 * 

* figures 2,3 * 

EP 0 320 329 A (NORTHERN TELECOM LTD) 
14 June 1989 

* abstract * 



1-4,6,7, 
9,11,12 



1,7,9 



G10H1/00 
G10K15/02 



TECHNICAL FIELDS 
SEARCHED (lnt.CI.6) 



G10H 
G10K 



The present search report has been drawn up for all claims 



Place ot searcn 

THE HAGUE 



Date ol completion of the search 

19 November 1998 



Hausser, T 



CATEGORY OF CITED DOCUMENTS 

X : particularly relevant if taken alone 

Y : particularly relevant if combined with another 

document of the same category 
A : technological background 
O : non-written disclosure 
P : intermediate document 



T : theory or principle underlying the invention 
E : earlier patent document, but published on. or 

after the filing date 
O : document cited in the application 
L : document cited for other reasons 



& : member of the same patent family, corresponding 
document 



OCID: <EP 07291 31 A3_L> 



2 



